Connected to Snowflake.
Customer: KIVA
Schema: KIVA_PROD.OPTIML
2023-02-19 2023-02-25

Total cost breakdown¶

Cost by usage category¶

Category: Credit and dollar consumption trends
----------------------------------------------
category_name      credits_previous_week    dollars_previous_week    credits    dollars    pct_change_dollars
---------------  -----------------------  -----------------------  ---------  ---------  --------------------
Cloud services                     33.64                    67.29      33.75      67.5                   0.31
Compute                           598.26                  1196.52     595.47    1190.95                 -0.47
Storage                             0                       49.88       0         53.81                  7.88
Total                             631.9                   1313.68     629.22    1312.25                 -0.11

Cost by user¶

Users: Credit consumption trends
--------------------------------
user_name                  approximate_credits_previous_week    approximate_credits    pct_change_credits
-----------------------  -----------------------------------  ---------------------  --------------------
AMPLITUDE                                               0.02                   0.02                  0
ANALYTICS_EXERCISE_USER                                 0                      0.52                inf
DBT_DEV                                                49.37                  46.89                 -5.02
DBT_PROD                                              100.86                  95.85                 -4.97
FIVETRAN_USER                                         274.72                 263.97                 -3.91
FIVETRAN_USER_DEV                                      44.49                  39.94                -10.23
GREGORYW                                                0.25                   0.54                116
GREGORYW_DEV                                            1.65                   2.21                 33.94
HUGOV_DEV                                               0.59                   0.01                -98.31
LOOKER_DEV_ADMIN                                        2.57                   2.26                -12.06
LOOKER_PROD                                            27.06                  22.5                 -16.85
LOOKER_PROD_ADMIN                                      10.9                   10.46                 -4.04
LOOKER_RAW_DEV                                          0.3                    0.31                  3.33
LOOKER_RAW_PROD                                         2.99                   3.4                  13.71
MAXH_DEV                                                0.01                   0                  -100
ML_SERVICE_DEV                                         41.96                  53.6                  27.74
ML_SERVICE_PROD                                        32.49                  38.94                 19.85
OPTIML                                                  0.39                   0.39                  0
ROBS                                                    0.03                   0.07                133.33
VERTEX_API_DEV                                          1.3                    1.49                 14.62
VERTEX_API_DEV_JENKINS                                  0.22                   0.41                 86.36
VERTEX_API_PROD                                        39.73                  44.69                 12.48
PATRICKL_DEV                                            0                      0.72                inf
Total                                                 631.9                  629.19                 -0.43
List of low usage users (<1% of credits) with usage (Current month)
-------------------------------------------------------------------
user_name                  approximate_credits    percent_usage
-----------------------  ---------------------  ---------------
AMPLITUDE                                 0.02            0.003
ANALYTICS_EXERCISE_USER                   0.52            0.083
GREGORYW                                  0.54            0.086
GREGORYW_DEV                              2.21            0.351
HUGOV_DEV                                 0.01            0.002
LOOKER_DEV_ADMIN                          2.26            0.359
LOOKER_RAW_DEV                            0.31            0.049
LOOKER_RAW_PROD                           3.4             0.54
MAXH_DEV                                  0               0
OPTIML                                    0.39            0.062
ROBS                                      0.07            0.011
VERTEX_API_DEV                            1.49            0.237
VERTEX_API_DEV_JENKINS                    0.41            0.065
PATRICKL_DEV                              0.72            0.114

Cost by warehouse¶

Warehouses: Credit consumption trends
-------------------------------------
warehouse_name         credits_previous_week    credits    pct_change_credits
-------------------  -----------------------  ---------  --------------------
DEV_WH                                142.6      148.96                  4.46
ML_WH                                  26.25      33.06                 25.94
PROD_AUX_WH                            54.95      52.55                 -4.37
PROD_WH                               408.1      394.64                 -3.3
CLOUD_SERVICES_ONLY                     0          0                     0
Total                                 629.21     631.9                   0.43

Cost by Partner Tools¶

Client Application: Credit consumption trends
---------------------------------------------
client_application_name      approximate_credits_previous_week    approximate_credits    pct_change_credits
-------------------------  -----------------------------------  ---------------------  --------------------
Go                                                        0.39                   0.57                 46.15
JDBC                                                    363.09                 342.95                 -5.55
ODBC                                                     41.25                  46.59                 12.95
Python                                                  227.16                 238.59                  5.03
Snowflake UI                                              0.01                   0.52               5100
Total                                                   631.9                  629.22                 -0.42

Resource monitoring¶

Generate Resource Monitors for the dataware house based on data from this week¶

Query templates for you to generate resource monitor for this week

USE ROLE ACCOUNTADMIN;
CREATE OR REPLACE RESOURCE MONITOR DEV_WH_RESOURCE_MONITOR 
WITH CREDIT_QUOTA=24.9
FREQUENCY=DAILY
START_TIMESTAMP=YYYY-MM-DD HH:MM:SS PST
TRIGGERS ON 100 PERCENT DO NOTIFY;
ALTER WAREHOUSE DEV_WH SET RESOURCE_MONITOR=DEV_WH_RESOURCE_MONITOR;


USE ROLE ACCOUNTADMIN;
CREATE OR REPLACE RESOURCE MONITOR ML_WH_RESOURCE_MONITOR 
WITH CREDIT_QUOTA=4.5
FREQUENCY=DAILY
START_TIMESTAMP=YYYY-MM-DD HH:MM:SS PST
TRIGGERS ON 100 PERCENT DO NOTIFY;
ALTER WAREHOUSE ML_WH SET RESOURCE_MONITOR=ML_WH_RESOURCE_MONITOR;


USE ROLE ACCOUNTADMIN;
CREATE OR REPLACE RESOURCE MONITOR PROD_AUX_WH_RESOURCE_MONITOR 
WITH CREDIT_QUOTA=9.46
FREQUENCY=DAILY
START_TIMESTAMP=YYYY-MM-DD HH:MM:SS PST
TRIGGERS ON 100 PERCENT DO NOTIFY;
ALTER WAREHOUSE PROD_AUX_WH SET RESOURCE_MONITOR=PROD_AUX_WH_RESOURCE_MONITOR;


USE ROLE ACCOUNTADMIN;
CREATE OR REPLACE RESOURCE MONITOR PROD_WH_RESOURCE_MONITOR 
WITH CREDIT_QUOTA=62.54
FREQUENCY=DAILY
START_TIMESTAMP=YYYY-MM-DD HH:MM:SS PST
TRIGGERS ON 100 PERCENT DO NOTIFY;
ALTER WAREHOUSE PROD_WH SET RESOURCE_MONITOR=PROD_WH_RESOURCE_MONITOR;

Runbook¶

  • If the resource monitor did not send a notification last week and the new resource monitor proposed is within 10% of previous monitor - dont update the resource monitor

  • If the resource monitor sent a notification last week due to an unexplained usage that cannot be attributed to legitimate use continue to debug and dont change the resource monitor

  • If the resource monitor sent a notification last week that can be attributed to legitimate use update the resource monitor

  • If the new resource monitor values are >10% over last week's values update the resource monitor